VIDEO CODER EMPLOYING PIXEL TRANSPOSITION 
BACKGROUND OF THE INVENTION 

The present invention relates to block based video 
coding schemes and, most particularly, to a method of 

n • 5 eliminating artifacts at block boundaries by transposing 
pixels at block boundaries with pixels from boundaries of 

^ " neighboring blocks before coding. 

£3 

Known systems for coding video information 
53 advantageously employ transform coding of a plurality of 

g ' 10 blocks or macro blocks. In such systems, image data often 
M are filtered, broken down into a luminance component and two 

^ chrominance components, and organized into blocks of image 

O data. For example, according to the proposed MPEG-4 video 

standard, image data are organized first into blocks, each 
15 containing an 8 pixel by 8 pixel array of data, then into 
macro blocks including up to four luminance blocks and two 
chrominance blocks. The blocks of image data are then 
transform coded from a pixel domain to an array of transform 
coefficients and scaled by a quantization parameter and 
20 transmitted in an output bit stream. 

Block-based transform coding is preferred over other 
known coding schemes, such as wavelet coding, because it is 
relatively less complex to implement. However, such block- 
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based transform coding causes annoying artifacts in the 
reconstructed image. Quantization parameters may be 
established for each block or macro block of image data. 
Differences in quantization parameters among the various 
blocks or macro blocks result in distortion at the block 
boundaries. For instance, in flat image areas, such 
distortions impose a patchwork effect on reconstructed image 
data. Similar artifacts appear in image areas having heavy 
texture, but are less noticeable. Block based coding with 
variable quantization causes additional artifacts to arise, 
such as chromo-bleeding, "mosquito-noise" and "ringing" 
artifacts . 

Prior systems have attempted to ameliorate the effect of 
such artifacts by low pass filtering reconstructed image data 
at block boundaries. However, while low pass filtering 
reduces block artifacts, it also causes blurring of image 
data. Low pass filtering impairs image quality. 

There is a need in the art for an image coder that 
advantageously employs block-based transform coding and 
quantization but reduces image artifacts at block boundaries. 
Further, there is a need in the art for a coding scheme that 
reduces artifacts without unnecessarily blurring image data. 

SUMMARY OF THE INVENTION 

The disadvantages of the prior art are alleviated to a 
great extent by an image coding scheme that employs block- 
based transform coding and quantization. An encoder 
transposes pixels across block boundaries in a predetermined 
direction prior to transform coding. For example, alternate 
pixels along a boundary of a first block may be transposed 
with adjacent pixels in a diagonal direction of neighboring 
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blocks. After transposition, each reformed block undergoes 
transform coding and quantization. 

A decoder performs reverse operations of those employed 
by the encoder. Each coded block is dequantized and coded by 
an inverse transform to reconstruct blocks of pixel 
information. At the conclusion of the inverse transform, 
pixels that were subject to transposition are returned to the 
neighboring blocks from which they originated. After 
transposition, each block may be processed further for 
display. 

The pixel transposition reduces image artifacts at block 
boundaries and improves image quality, particularly in flat 
image areas. By including cross border pixels in the 
transform coding and quantization, the transform coding and 
quantization are performed with greater uniformity on image 
data . 

BRIEF DESCRIPTION OF THE DRAWINGS 

/ S 

Fig£. Irfaj — em - d ' 3 Hb - ) respectively illustrate an encoder 

A 

100 and a decoder 200 according to an embodiment of the 
present invention . 

Figs. 2(a) and 2(b) respectively illustrate the pixel 
transposition operation of the present invention as applied 
to blocks and macro blocks of image data. 

DETAILED DESCRIPTION 

Turning to Fig. 1(a), circuitry of an encoder 100 is 
illustrated therein constructed in accordance with an 
embodiment of the present invention. Blocks or macro blocks 
of image data are input to a pixel transposition circuit 110. 
Each block possesses one of luminance or chrominance image 
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data. The pixel transposition circuit 110 transposes 
specific pixels from the boundary of each block or macro 
block with pixels from its neighbors. The pixel 

transposition circuit 110 then outputs reconstituted blocks 
of pixel data to a transform coder 120. The transform coder 
120 performs a transform of the block data from a pixel 
domain to a domain of coefficients representative of the 
pixel data. For example, the transform coder 120 may perform 
a discrete cosine transform as is known in the art. The 
transform coder 120 outputs blocks of coefficient data to a 
quantizer 130. For each block or macro block, the quantizer 
130 generates a quantizer parameter (Q p ) based upon the 
bandwidth of a channel available to transmit the coded image 
data. The quantizer 130 scales the coefficients of the block 
by the quantization parameter. The quantizer 130 outputs 
blocks of scaled coefficient information and the quantization 
parameters generated for each for further processing and 
transmission. 

Fig. 1(b) illustrates circuitry of a decoder 200 
constructed in accordance with an embodiment of the present 
invention. Blocks of scaled coefficients are isolated from 
the transmitted bit stream and input to a dequantizer 230. 
The dequantizer 230 identifies the quantization parameter for 
each block and scales the scaled coefficients of the block by 
the quantization parameter. Where the quantizer 130 may have 
divided each coefficient by Qp, the dequantizer multiplies 
the scaled coefficients by the same Qp to obtain the original 
coefficients. The dequantizer 230 outputs reconstructed 
coefficient data to an inverse transform coding circuit 220. 
The inverse transform coding circuit 220 transforms the 
coefficients back to the pixel domain, such as by discrete 
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transform coding. The inverse transform coding circuit 220 
outputs blocks or macro blocks of reconstructed pixel data to 
an inverse pixel transposition circuit 210. For each block 
or macro block, the inverse pixel transposition circuit 210 
transposes pixels along its boundary with pixels of its 
neighbors in a direction complementary to the process applied 
by the pixel transposition circuit 110. The inverse pixel 
transposition circuit 210 returns pixels to their original 
position in the neighboring blocks or macro blocks. The 
inverse pixel transposition circuit 110 outputs blocks of 
pixel information for further processing and display. 

An example of a pixel transposition process is shown in 
Fig. 2(a) applied on a block by block basis. For each block 
A, the pixel transposition circuit 110 stores, in memory, 
pixel information from a plurality of surrounding Blocks 1-8. 
The pixel transposition circuit 110 transposes pixel 
information in a predetermined direction. In the example of 
Fig. 2(a), the pixels are transposed along a diagonal 
direction from high-left to low-right and vice versa. 

Under the pixel transposition process, each alternate 
pixel on the edge of a given block A is transposed with a 
pixel across the block boundary in the predetermined 
direction. In the example of Fig. 2(a), the pixel in the 
upper left-hand corner of block A is transposed with a pixel 
in the lower right-hand corner of block 1. Three pixels 
along the upper edge of block A are transposed with pixels on 
the lower edge of block 2 in the same diagonal direction. 
Alternate pixels found on the right-hand edge of block A are 
transposed with pixels on the left-hand edge of block 4 in 
the diagonal direction. The pixel in the lower right-hand 
corner of block A is transposed with a pixel in the upper 
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left-hand corner of block 5. Alternate pixels on the lower 
edge of block A are transposed with pixels on the upper edge 
of block 6 in the diagonal direction. Finally, alternate 
pixels on the left hand edge of block 8 are transposed with 
pixels found on the right-hand edge of block 8 in the 
diagonal direction . 

Pixel transposition is performed only on like-kind data. 
When performing pixel transposition on a luminance block, the 
pixel transposition circuit 110 considers only neighboring 
luminance blocks for transposition. Similarly, for blocks of 
each of the two chrominance signals, pixel transposition is 
performed only with neighboring chrominance image blocks of 
the same type. 

Fig. 2(b) illustrates an example where pixel 
transposition is performed on a macro block by macro block 
basis. In the event that the quantizer circuit 130 computes 
quantization parameters for each macro block rather than for 
each block, it is preferable to perform a pixel transposition 
on a macro block by macro block basis. In this example, a 
macro block consists of four blocks of image information, 
Blocks A-D. The macro block is surrounded by twelve 
neighboring blocks, Blocks 1-12. For the macro block, pixel 
transposition is performed on alternate pixels on the 
boundary of the macro block with pixel information of 
neighboring macro blocks along a pre-determined direction. 
In this example, the predetermined direction is from low-left 
to high-right and vice versa. As shown in Fig. 2(b), the 

pixel in the upper right-hand corner of Block B is transposed 
with a pixel in the lower left-hand corner of Block 4. 
Similarly, a pixel in a lower left-hand corner of Block C is 
transposed with a pixel in the upper right-hand corner of 
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Block 10.- Alternate pixels on the top edge of the macro 
block, the top edges of Blocks A and B, are transposed with 
pixels on the bottom edges of Blocks 2 and 3 in a diagonal 
direction. Pixels on the right-hand edge of the macro block, 
the right-hand edges of Blocks B and D, are transformed on 
the left-hand edges of Blocks 5 and 6 in the diagonal 
direction. Blocks on the lower edge of the macro block, the 
lower edges of Blocks C and D, are transposed with pixels 
found in the diagonal direction on the upper edges of Blocks 
8 and 9. Finally, pixels found on the left-hand edge of the 
macro block, the left-hand edges of Blocks A and C, are 
transposed with pixels found in a diagonal direction in the 
right-hand edges of Blocks 11 and 12. 

The direction of transposition is arbitrary. Any 
direction may be applied. In addition to high-left to low- 
right and low-left to high-right, horizontal (right to left) 
and vertical (above to below) directions may be applied. The 
direction may be predetermined by the system or defined for 
each coded video frame. If the direction of transposition is 
variable, the pixel transposition circuit 110 includes a 
transposition keyword in the output bitstream identifying the 
direction of transposition. The decoder identifies the 
transposition keyword and identifies a directions of 
transposition therefrom. 

So, too, the pattern of transposition may varied. In 
addition to selection of alternate pixels for transposition, 
every third or every fourth pixel may be selected for 
transposition. Further, the pattern may varied so as to 
select pixels at a first rate, such as every other pixel, in 
a first region of data, then a second rate, such as every 
fourth pixel, in a second region of data. 
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The encoder 100 and decoder 200 shown in Figs. 1(a) and 
1(b) are not full video coders. Preprocessing is generally 
performed on pixels before they are input to the pixel 
transposition circuit 110, which generally involves sampling 
of image data, conversion to a digital format, filtering, and 
component isolation. Preprocessing also includes 

organization of the component signals into blocks. However, 
in a preferred embodiment, preprocessing functions may be 
merged into the pixel transposition circuit 110. In this 
case, the pixel transposition circuit may be programmed to 
reorder pixels before they are organized into blocks. 
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